Dataset statistics
| Number of variables | 113 |
|---|---|
| Number of observations | 621 |
| Missing cells | 49680 |
| Missing cells (%) | 70.8% |
| Duplicate rows | 0 |
| Duplicate rows (%) | 0.0% |
| Total size in memory | 535.6 KiB |
| Average record size in memory | 883.2 B |
Variable types
| Categorical | 18 |
|---|---|
| Text | 1 |
| Numeric | 11 |
| Unsupported | 80 |
| Boolean | 3 |
Engine has constant value "vllm" | Constant |
Model has constant value "meta-llama/Meta-Llama-3.1-8B-Instruct" | Constant |
model_name has constant value "meta-llama/Meta-Llama-3.1-8B-Instruct" | Constant |
tensor_parallel_size has constant value "2" | Constant |
pipeline_parallel_size has constant value "1" | Constant |
kv_cache_dtype has constant value "auto" | Constant |
gpu_memory_utilization has constant value "0.9" | Constant |
swap_space has constant value "4" | Constant |
cpu_kv_cache_size has constant value "40" | Constant |
block_size has constant value "8" | Constant |
enable_prefix_cache has constant value "False" | Constant |
disable_sliding_window has constant value "False" | Constant |
enforce_eager has constant value "False" | Constant |
max_seq_len_to_capture has constant value "8192" | Constant |
attention_backend has constant value "TORCH_SDPA" | Constant |
attn_input_reshape_min has 621 (100.0%) missing values | Missing |
attn_input_reshape_max has 621 (100.0%) missing values | Missing |
attn_input_reshape_mean has 621 (100.0%) missing values | Missing |
attn_input_reshape_median has 621 (100.0%) missing values | Missing |
attn_input_reshape_std has 621 (100.0%) missing values | Missing |
attn_kv_cache_save_min has 621 (100.0%) missing values | Missing |
attn_kv_cache_save_max has 621 (100.0%) missing values | Missing |
attn_kv_cache_save_mean has 621 (100.0%) missing values | Missing |
attn_kv_cache_save_median has 621 (100.0%) missing values | Missing |
attn_kv_cache_save_std has 621 (100.0%) missing values | Missing |
attn_prefill_min has 621 (100.0%) missing values | Missing |
attn_prefill_max has 621 (100.0%) missing values | Missing |
attn_prefill_mean has 621 (100.0%) missing values | Missing |
attn_prefill_median has 621 (100.0%) missing values | Missing |
attn_prefill_std has 621 (100.0%) missing values | Missing |
attn_decode_min has 621 (100.0%) missing values | Missing |
attn_decode_max has 621 (100.0%) missing values | Missing |
attn_decode_mean has 621 (100.0%) missing values | Missing |
attn_decode_median has 621 (100.0%) missing values | Missing |
attn_decode_std has 621 (100.0%) missing values | Missing |
attn_output_reshape_min has 621 (100.0%) missing values | Missing |
attn_output_reshape_max has 621 (100.0%) missing values | Missing |
attn_output_reshape_mean has 621 (100.0%) missing values | Missing |
attn_output_reshape_median has 621 (100.0%) missing values | Missing |
attn_output_reshape_std has 621 (100.0%) missing values | Missing |
embed_min has 621 (100.0%) missing values | Missing |
embed_max has 621 (100.0%) missing values | Missing |
embed_mean has 621 (100.0%) missing values | Missing |
embed_median has 621 (100.0%) missing values | Missing |
embed_std has 621 (100.0%) missing values | Missing |
input_layernorm_min has 621 (100.0%) missing values | Missing |
input_layernorm_max has 621 (100.0%) missing values | Missing |
input_layernorm_mean has 621 (100.0%) missing values | Missing |
input_layernorm_median has 621 (100.0%) missing values | Missing |
input_layernorm_std has 621 (100.0%) missing values | Missing |
attn_pre_proj_min has 621 (100.0%) missing values | Missing |
attn_pre_proj_max has 621 (100.0%) missing values | Missing |
attn_pre_proj_mean has 621 (100.0%) missing values | Missing |
attn_pre_proj_median has 621 (100.0%) missing values | Missing |
attn_pre_proj_std has 621 (100.0%) missing values | Missing |
attn_rope_min has 621 (100.0%) missing values | Missing |
attn_rope_max has 621 (100.0%) missing values | Missing |
attn_rope_mean has 621 (100.0%) missing values | Missing |
attn_rope_median has 621 (100.0%) missing values | Missing |
attn_rope_std has 621 (100.0%) missing values | Missing |
attn_post_proj_min has 621 (100.0%) missing values | Missing |
attn_post_proj_max has 621 (100.0%) missing values | Missing |
attn_post_proj_mean has 621 (100.0%) missing values | Missing |
attn_post_proj_median has 621 (100.0%) missing values | Missing |
attn_post_proj_std has 621 (100.0%) missing values | Missing |
post_attention_layernorm_min has 621 (100.0%) missing values | Missing |
post_attention_layernorm_max has 621 (100.0%) missing values | Missing |
post_attention_layernorm_mean has 621 (100.0%) missing values | Missing |
post_attention_layernorm_median has 621 (100.0%) missing values | Missing |
post_attention_layernorm_std has 621 (100.0%) missing values | Missing |
mlp_up_proj_min has 621 (100.0%) missing values | Missing |
mlp_up_proj_max has 621 (100.0%) missing values | Missing |
mlp_up_proj_mean has 621 (100.0%) missing values | Missing |
mlp_up_proj_median has 621 (100.0%) missing values | Missing |
mlp_up_proj_std has 621 (100.0%) missing values | Missing |
mlp_act_min has 621 (100.0%) missing values | Missing |
mlp_act_max has 621 (100.0%) missing values | Missing |
mlp_act_mean has 621 (100.0%) missing values | Missing |
mlp_act_median has 621 (100.0%) missing values | Missing |
mlp_act_std has 621 (100.0%) missing values | Missing |
mlp_down_proj_min has 621 (100.0%) missing values | Missing |
mlp_down_proj_max has 621 (100.0%) missing values | Missing |
mlp_down_proj_mean has 621 (100.0%) missing values | Missing |
mlp_down_proj_median has 621 (100.0%) missing values | Missing |
mlp_down_proj_std has 621 (100.0%) missing values | Missing |
mlp_add_min has 621 (100.0%) missing values | Missing |
mlp_add_max has 621 (100.0%) missing values | Missing |
mlp_add_mean has 621 (100.0%) missing values | Missing |
mlp_add_median has 621 (100.0%) missing values | Missing |
mlp_add_std has 621 (100.0%) missing values | Missing |
distributed_backend has 621 (100.0%) missing values | Missing |
max_num_batched_tokens has 621 (100.0%) missing values | Missing |
enable_chunked_prefill has 621 (100.0%) missing values | Missing |
quantization has 621 (100.0%) missing values | Missing |
rope_scaling has 621 (100.0%) missing values | Missing |
run_id has unique values | Unique |
Mean TTFT (ms) has unique values | Unique |
attn_input_reshape_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_input_reshape_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_input_reshape_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_input_reshape_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_input_reshape_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_kv_cache_save_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_kv_cache_save_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_kv_cache_save_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_kv_cache_save_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_kv_cache_save_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_prefill_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_prefill_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_prefill_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_prefill_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_prefill_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_decode_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_decode_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_decode_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_decode_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_decode_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_output_reshape_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_output_reshape_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_output_reshape_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_output_reshape_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_output_reshape_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
embed_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
embed_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
embed_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
embed_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
embed_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
input_layernorm_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
input_layernorm_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
input_layernorm_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
input_layernorm_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
input_layernorm_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_pre_proj_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_pre_proj_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_pre_proj_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_pre_proj_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_pre_proj_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_rope_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_rope_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_rope_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_rope_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_rope_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_post_proj_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_post_proj_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_post_proj_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_post_proj_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
attn_post_proj_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
post_attention_layernorm_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
post_attention_layernorm_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
post_attention_layernorm_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
post_attention_layernorm_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
post_attention_layernorm_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_up_proj_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_up_proj_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_up_proj_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_up_proj_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_up_proj_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_act_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_act_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_act_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_act_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_act_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_down_proj_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_down_proj_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_down_proj_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_down_proj_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_down_proj_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_add_min is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_add_max is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_add_mean is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_add_median is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
mlp_add_std is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
distributed_backend is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
max_num_batched_tokens is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
enable_chunked_prefill is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
quantization is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
rope_scaling is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
Reproduction
| Analysis started | 2024-09-28 08:18:12.453109 |
|---|---|
| Analysis finished | 2024-09-28 08:18:35.732404 |
| Duration | 23.28 seconds |
| Software version | ydata-profiling vv4.10.0 |
| Download configuration | config.json |
Engine
Categorical
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| vllm |
|---|
Length
| Max length | 4 |
|---|---|
| Median length | 4 |
| Mean length | 4 |
| Min length | 4 |
Characters and Unicode
| Total characters | 2484 |
|---|---|
| Distinct characters | 3 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | vllm |
|---|---|
| 2nd row | vllm |
| 3rd row | vllm |
| 4th row | vllm |
| 5th row | vllm |
Common Values
| Value | Count | Frequency (%) |
| vllm | 621 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| vllm | 621 |
Most occurring characters
| Value | Count | Frequency (%) |
| l | 1242 | |
| v | 621 | |
| m | 621 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 2484 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| l | 1242 | |
| v | 621 | |
| m | 621 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 2484 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| l | 1242 | |
| v | 621 | |
| m | 621 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 2484 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| l | 1242 | |
| v | 621 | |
| m | 621 |
engine_config_id
Categorical
| Distinct | 12 |
|---|---|
| Distinct (%) | 1.9% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| c82767ea | |
|---|---|
| 7c22728c | |
| e9d9877a | |
| bf298285 | |
| 6f28cde9 | |
| Other values (7) |
Length
| Max length | 8 |
|---|---|
| Median length | 8 |
| Mean length | 8 |
| Min length | 8 |
Characters and Unicode
| Total characters | 4968 |
|---|---|
| Distinct characters | 15 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | c82767ea |
|---|---|
| 2nd row | c82767ea |
| 3rd row | c82767ea |
| 4th row | c82767ea |
| 5th row | c82767ea |
Common Values
| Value | Count | Frequency (%) |
| c82767ea | 63 | |
| 7c22728c | 63 | |
| e9d9877a | 63 | |
| bf298285 | 63 | |
| 6f28cde9 | 63 | |
| f6f9bcf8 | 63 | |
| 35918276 | 63 | |
| b1e23d38 | 63 | |
| 4e74f945 | 59 | |
| bad28275 | 20 | 3.2% |
| Other values (2) | 38 |
Length
Histogram of lengths of the category
| Value | Count | Frequency (%) |
| c82767ea | 63 | |
| 7c22728c | 63 | |
| e9d9877a | 63 | |
| bf298285 | 63 | |
| 6f28cde9 | 63 | |
| f6f9bcf8 | 63 | |
| 35918276 | 63 | |
| b1e23d38 | 63 | |
| 4e74f945 | 59 | |
| bad28275 | 20 | 3.2% |
| Other values (2) | 38 |
Most occurring characters
| Value | Count | Frequency (%) |
| 2 | 626 | |
| 8 | 606 | |
| 7 | 558 | |
| 9 | 475 | |
| f | 374 | |
| c | 334 | 6.7% |
| e | 311 | 6.3% |
| d | 266 | 5.4% |
| 6 | 252 | 5.1% |
| 5 | 243 | 4.9% |
| Other values (5) | 923 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 4968 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| 2 | 626 | |
| 8 | 606 | |
| 7 | 558 | |
| 9 | 475 | |
| f | 374 | |
| c | 334 | 6.7% |
| e | 311 | 6.3% |
| d | 266 | 5.4% |
| 6 | 252 | 5.1% |
| 5 | 243 | 4.9% |
| Other values (5) | 923 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 4968 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| 2 | 626 | |
| 8 | 606 | |
| 7 | 558 | |
| 9 | 475 | |
| f | 374 | |
| c | 334 | 6.7% |
| e | 311 | 6.3% |
| d | 266 | 5.4% |
| 6 | 252 | 5.1% |
| 5 | 243 | 4.9% |
| Other values (5) | 923 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 4968 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| 2 | 626 | |
| 8 | 606 | |
| 7 | 558 | |
| 9 | 475 | |
| f | 374 | |
| c | 334 | 6.7% |
| e | 311 | 6.3% |
| d | 266 | 5.4% |
| 6 | 252 | 5.1% |
| 5 | 243 | 4.9% |
| Other values (5) | 923 |
run_id
Text
UNIQUE
| Distinct | 621 |
|---|---|
| Distinct (%) | 100.0% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
Length
| Max length | 8 |
|---|---|
| Median length | 8 |
| Mean length | 8 |
| Min length | 8 |
Characters and Unicode
| Total characters | 4968 |
|---|---|
| Distinct characters | 16 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 621 ? |
|---|---|
| Unique (%) | 100.0% |
Sample
| 1st row | e67282eb |
|---|---|
| 2nd row | 7d6bf0cd |
| 3rd row | d5a06a09 |
| 4th row | d450ced3 |
| 5th row | 935cadeb |
| Value | Count | Frequency (%) |
| aaea0149 | 1 | 0.2% |
| 044b3dde | 1 | 0.2% |
| e67282eb | 1 | 0.2% |
| 7d6bf0cd | 1 | 0.2% |
| d5a06a09 | 1 | 0.2% |
| d450ced3 | 1 | 0.2% |
| 935cadeb | 1 | 0.2% |
| c2ef6f38 | 1 | 0.2% |
| 88b77240 | 1 | 0.2% |
| c2f59fc1 | 1 | 0.2% |
| Other values (611) | 611 |
Most occurring characters
| Value | Count | Frequency (%) |
| 6 | 348 | 7.0% |
| a | 337 | 6.8% |
| b | 324 | 6.5% |
| 0 | 324 | 6.5% |
| e | 323 | 6.5% |
| d | 315 | 6.3% |
| 8 | 308 | 6.2% |
| 9 | 307 | 6.2% |
| 4 | 306 | 6.2% |
| 3 | 306 | 6.2% |
| Other values (6) | 1770 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 4968 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| 6 | 348 | 7.0% |
| a | 337 | 6.8% |
| b | 324 | 6.5% |
| 0 | 324 | 6.5% |
| e | 323 | 6.5% |
| d | 315 | 6.3% |
| 8 | 308 | 6.2% |
| 9 | 307 | 6.2% |
| 4 | 306 | 6.2% |
| 3 | 306 | 6.2% |
| Other values (6) | 1770 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 4968 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| 6 | 348 | 7.0% |
| a | 337 | 6.8% |
| b | 324 | 6.5% |
| 0 | 324 | 6.5% |
| e | 323 | 6.5% |
| d | 315 | 6.3% |
| 8 | 308 | 6.2% |
| 9 | 307 | 6.2% |
| 4 | 306 | 6.2% |
| 3 | 306 | 6.2% |
| Other values (6) | 1770 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 4968 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| 6 | 348 | 7.0% |
| a | 337 | 6.8% |
| b | 324 | 6.5% |
| 0 | 324 | 6.5% |
| e | 323 | 6.5% |
| d | 315 | 6.3% |
| 8 | 308 | 6.2% |
| 9 | 307 | 6.2% |
| 4 | 306 | 6.2% |
| 3 | 306 | 6.2% |
| Other values (6) | 1770 |
Model
Categorical
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| meta-llama/Meta-Llama-3.1-8B-Instruct |
|---|
Length
| Max length | 37 |
|---|---|
| Median length | 37 |
| Mean length | 37 |
| Min length | 37 |
Characters and Unicode
| Total characters | 22977 |
|---|---|
| Distinct characters | 20 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | meta-llama/Meta-Llama-3.1-8B-Instruct |
|---|---|
| 2nd row | meta-llama/Meta-Llama-3.1-8B-Instruct |
| 3rd row | meta-llama/Meta-Llama-3.1-8B-Instruct |
| 4th row | meta-llama/Meta-Llama-3.1-8B-Instruct |
| 5th row | meta-llama/Meta-Llama-3.1-8B-Instruct |
Common Values
| Value | Count | Frequency (%) |
| meta-llama/Meta-Llama-3.1-8B-Instruct | 621 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| meta-llama/meta-llama-3.1-8b-instruct | 621 |
Most occurring characters
| Value | Count | Frequency (%) |
| a | 3726 | |
| - | 3105 | |
| t | 2484 | 10.8% |
| m | 1863 | 8.1% |
| l | 1863 | 8.1% |
| e | 1242 | 5.4% |
| / | 621 | 2.7% |
| M | 621 | 2.7% |
| L | 621 | 2.7% |
| 3 | 621 | 2.7% |
| Other values (10) | 6210 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 22977 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| a | 3726 | |
| - | 3105 | |
| t | 2484 | 10.8% |
| m | 1863 | 8.1% |
| l | 1863 | 8.1% |
| e | 1242 | 5.4% |
| / | 621 | 2.7% |
| M | 621 | 2.7% |
| L | 621 | 2.7% |
| 3 | 621 | 2.7% |
| Other values (10) | 6210 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 22977 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| a | 3726 | |
| - | 3105 | |
| t | 2484 | 10.8% |
| m | 1863 | 8.1% |
| l | 1863 | 8.1% |
| e | 1242 | 5.4% |
| / | 621 | 2.7% |
| M | 621 | 2.7% |
| L | 621 | 2.7% |
| 3 | 621 | 2.7% |
| Other values (10) | 6210 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 22977 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| a | 3726 | |
| - | 3105 | |
| t | 2484 | 10.8% |
| m | 1863 | 8.1% |
| l | 1863 | 8.1% |
| e | 1242 | 5.4% |
| / | 621 | 2.7% |
| M | 621 | 2.7% |
| L | 621 | 2.7% |
| 3 | 621 | 2.7% |
| Other values (10) | 6210 |
Mean Input Tokens
Categorical
| Distinct | 3 |
|---|---|
| Distinct (%) | 0.5% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| 50 | |
|---|---|
| 200 | |
| 550 |
Length
| Max length | 3 |
|---|---|
| Median length | 3 |
| Mean length | 2.6022544 |
| Min length | 2 |
Characters and Unicode
| Total characters | 1616 |
|---|---|
| Distinct characters | 3 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 50 |
|---|---|
| 2nd row | 50 |
| 3rd row | 50 |
| 4th row | 50 |
| 5th row | 50 |
Common Values
| Value | Count | Frequency (%) |
| 50 | 247 | |
| 200 | 189 | |
| 550 | 185 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 50 | 247 | |
| 200 | 189 | |
| 550 | 185 |
Most occurring characters
| Value | Count | Frequency (%) |
| 0 | 810 | |
| 5 | 617 | |
| 2 | 189 | 11.7% |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 1616 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| 0 | 810 | |
| 5 | 617 | |
| 2 | 189 | 11.7% |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 1616 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| 0 | 810 | |
| 5 | 617 | |
| 2 | 189 | 11.7% |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 1616 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| 0 | 810 | |
| 5 | 617 | |
| 2 | 189 | 11.7% |
Mean Output Tokens
Categorical
| Distinct | 3 |
|---|---|
| Distinct (%) | 0.5% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| 128 | |
|---|---|
| 250 | |
| 550 |
Length
| Max length | 3 |
|---|---|
| Median length | 3 |
| Mean length | 3 |
| Min length | 3 |
Characters and Unicode
| Total characters | 1863 |
|---|---|
| Distinct characters | 5 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 128 |
|---|---|
| 2nd row | 128 |
| 3rd row | 128 |
| 4th row | 128 |
| 5th row | 128 |
Common Values
| Value | Count | Frequency (%) |
| 128 | 210 | |
| 250 | 210 | |
| 550 | 201 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 128 | 210 | |
| 250 | 210 | |
| 550 | 201 |
Most occurring characters
| Value | Count | Frequency (%) |
| 5 | 612 | |
| 2 | 420 | |
| 0 | 411 | |
| 1 | 210 | 11.3% |
| 8 | 210 | 11.3% |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 1863 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| 5 | 612 | |
| 2 | 420 | |
| 0 | 411 | |
| 1 | 210 | 11.3% |
| 8 | 210 | 11.3% |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 1863 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| 5 | 612 | |
| 2 | 420 | |
| 0 | 411 | |
| 1 | 210 | 11.3% |
| 8 | 210 | 11.3% |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 1863 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| 5 | 612 | |
| 2 | 420 | |
| 0 | 411 | |
| 1 | 210 | 11.3% |
| 8 | 210 | 11.3% |
Concurrent Requests
Real number (ℝ)
| Distinct | 7 |
|---|---|
| Distinct (%) | 1.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 40.31401 |
| Minimum | 1 |
|---|---|
| Maximum | 100 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 5.0 KiB |
Quantile statistics
| Minimum | 1 |
|---|---|
| 5-th percentile | 1 |
| Q1 | 10 |
| median | 30 |
| Q3 | 75 |
| 95-th percentile | 100 |
| Maximum | 100 |
| Range | 99 |
| Interquartile range (IQR) | 65 |
Descriptive statistics
| Standard deviation | 33.30707 |
|---|---|
| Coefficient of variation (CV) | 0.82619095 |
| Kurtosis | -0.99590213 |
| Mean | 40.31401 |
| Median Absolute Deviation (MAD) | 20 |
| Skewness | 0.57672409 |
| Sum | 25035 |
| Variance | 1109.3609 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=7)
| Value | Count | Frequency (%) |
| 1 | 90 | |
| 10 | 90 | |
| 20 | 90 | |
| 30 | 89 | |
| 50 | 89 | |
| 75 | 87 | |
| 100 | 86 |
| Value | Count | Frequency (%) |
| 1 | 90 | |
| 10 | 90 | |
| 20 | 90 | |
| 30 | 89 | |
| 50 | 89 | |
| 75 | 87 | |
| 100 | 86 |
| Value | Count | Frequency (%) |
| 100 | 86 | |
| 75 | 87 | |
| 50 | 89 | |
| 30 | 89 | |
| 20 | 90 | |
| 10 | 90 | |
| 1 | 90 |
Completed Requests
Real number (ℝ)
| Distinct | 7 |
|---|---|
| Distinct (%) | 1.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 40.31401 |
| Minimum | 1 |
|---|---|
| Maximum | 100 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 5.0 KiB |
Quantile statistics
| Minimum | 1 |
|---|---|
| 5-th percentile | 1 |
| Q1 | 10 |
| median | 30 |
| Q3 | 75 |
| 95-th percentile | 100 |
| Maximum | 100 |
| Range | 99 |
| Interquartile range (IQR) | 65 |
Descriptive statistics
| Standard deviation | 33.30707 |
|---|---|
| Coefficient of variation (CV) | 0.82619095 |
| Kurtosis | -0.99590213 |
| Mean | 40.31401 |
| Median Absolute Deviation (MAD) | 20 |
| Skewness | 0.57672409 |
| Sum | 25035 |
| Variance | 1109.3609 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=7)
| Value | Count | Frequency (%) |
| 1 | 90 | |
| 10 | 90 | |
| 20 | 90 | |
| 30 | 89 | |
| 50 | 89 | |
| 75 | 87 | |
| 100 | 86 |
| Value | Count | Frequency (%) |
| 1 | 90 | |
| 10 | 90 | |
| 20 | 90 | |
| 30 | 89 | |
| 50 | 89 | |
| 75 | 87 | |
| 100 | 86 |
| Value | Count | Frequency (%) |
| 100 | 86 | |
| 75 | 87 | |
| 50 | 89 | |
| 30 | 89 | |
| 20 | 90 | |
| 10 | 90 | |
| 1 | 90 |
Duration (s)
Real number (ℝ)
| Distinct | 599 |
|---|---|
| Distinct (%) | 96.5% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 65.89599 |
| Minimum | 9.9 |
|---|---|
| Maximum | 408.99 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 5.0 KiB |
Quantile statistics
| Minimum | 9.9 |
|---|---|
| 5-th percentile | 12.19 |
| Q1 | 24.7 |
| median | 46.45 |
| Q3 | 85.98 |
| 95-th percentile | 181.91 |
| Maximum | 408.99 |
| Range | 399.09 |
| Interquartile range (IQR) | 61.28 |
Descriptive statistics
| Standard deviation | 59.166796 |
|---|---|
| Coefficient of variation (CV) | 0.89788158 |
| Kurtosis | 5.837341 |
| Mean | 65.89599 |
| Median Absolute Deviation (MAD) | 24.47 |
| Skewness | 2.1214577 |
| Sum | 40921.41 |
| Variance | 3500.7097 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 22.1 | 3 | 0.5% |
| 63.31 | 2 | 0.3% |
| 58.15 | 2 | 0.3% |
| 23.23 | 2 | 0.3% |
| 10.27 | 2 | 0.3% |
| 68.02 | 2 | 0.3% |
| 13.26 | 2 | 0.3% |
| 16.28 | 2 | 0.3% |
| 85.29 | 2 | 0.3% |
| 9.95 | 2 | 0.3% |
| Other values (589) | 600 |
| Value | Count | Frequency (%) |
| 9.9 | 1 | |
| 9.91 | 1 | |
| 9.95 | 2 | |
| 9.97 | 2 | |
| 9.99 | 2 | |
| 10.01 | 1 | |
| 10.05 | 1 | |
| 10.11 | 1 | |
| 10.25 | 1 | |
| 10.27 | 2 |
| Value | Count | Frequency (%) |
| 408.99 | 1 | |
| 401.67 | 1 | |
| 321.86 | 1 | |
| 319.48 | 1 | |
| 303.01 | 1 | |
| 296.74 | 1 | |
| 294.12 | 1 | |
| 270.36 | 1 | |
| 259.71 | 1 | |
| 257.09 | 1 |
Request Throughput (req/min)
Real number (ℝ)
| Distinct | 552 |
|---|---|
| Distinct (%) | 88.9% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 46.363527 |
| Minimum | 0.68 |
|---|---|
| Maximum | 225.81 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 5.0 KiB |
Quantile statistics
| Minimum | 0.68 |
|---|---|
| 5-th percentile | 1.5 |
| Q1 | 14.91 |
| median | 35.05 |
| Q3 | 66.41 |
| 95-th percentile | 130.83 |
| Maximum | 225.81 |
| Range | 225.13 |
| Interquartile range (IQR) | 51.5 |
Descriptive statistics
| Standard deviation | 41.999333 |
|---|---|
| Coefficient of variation (CV) | 0.90587012 |
| Kurtosis | 2.2972433 |
| Mean | 46.363527 |
| Median Absolute Deviation (MAD) | 22.64 |
| Skewness | 1.4465034 |
| Sum | 28791.75 |
| Variance | 1763.944 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 0.7 | 7 | 1.1% |
| 1.38 | 6 | 1.0% |
| 1.37 | 4 | 0.6% |
| 0.69 | 4 | 0.6% |
| 1.39 | 3 | 0.5% |
| 2.97 | 3 | 0.5% |
| 1.53 | 3 | 0.5% |
| 3.01 | 3 | 0.5% |
| 3 | 3 | 0.5% |
| 2.93 | 3 | 0.5% |
| Other values (542) | 582 |
| Value | Count | Frequency (%) |
| 0.68 | 1 | 0.2% |
| 0.69 | 4 | |
| 0.7 | 7 | |
| 1.35 | 2 | 0.3% |
| 1.36 | 3 | |
| 1.37 | 4 | |
| 1.38 | 6 | |
| 1.39 | 3 | |
| 1.49 | 1 | 0.2% |
| 1.5 | 1 | 0.2% |
| Value | Count | Frequency (%) |
| 225.81 | 1 | |
| 222.68 | 1 | |
| 221.4 | 1 | |
| 208.61 | 1 | |
| 204.97 | 1 | |
| 194.15 | 1 | |
| 177.72 | 1 | |
| 177.07 | 1 | |
| 175.27 | 1 | |
| 175.04 | 1 |
Output Token Throughput (tok/s)
Real number (ℝ)
| Distinct | 595 |
|---|---|
| Distinct (%) | 95.8% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 165.73842 |
| Minimum | 5.51 |
|---|---|
| Maximum | 471.88 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 5.0 KiB |
Quantile statistics
| Minimum | 5.51 |
|---|---|
| 5-th percentile | 6.35 |
| Q1 | 98.31 |
| median | 162.62 |
| Q3 | 233.06 |
| 95-th percentile | 352.03 |
| Maximum | 471.88 |
| Range | 466.37 |
| Interquartile range (IQR) | 134.75 |
Descriptive statistics
| Standard deviation | 105.36193 |
|---|---|
| Coefficient of variation (CV) | 0.63571217 |
| Kurtosis | -0.33178811 |
| Mean | 165.73842 |
| Median Absolute Deviation (MAD) | 65.27 |
| Skewness | 0.36761325 |
| Sum | 102923.56 |
| Variance | 11101.137 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 12.48 | 5 | 0.8% |
| 6.31 | 3 | 0.5% |
| 12.26 | 3 | 0.5% |
| 185.39 | 2 | 0.3% |
| 6.32 | 2 | 0.3% |
| 150.88 | 2 | 0.3% |
| 197.41 | 2 | 0.3% |
| 110.95 | 2 | 0.3% |
| 12.54 | 2 | 0.3% |
| 11.72 | 2 | 0.3% |
| Other values (585) | 596 |
| Value | Count | Frequency (%) |
| 5.51 | 1 | |
| 5.61 | 1 | |
| 5.62 | 1 | |
| 5.67 | 1 | |
| 5.7 | 2 | |
| 5.76 | 1 | |
| 5.78 | 1 | |
| 5.8 | 1 | |
| 5.81 | 1 | |
| 6.05 | 1 |
| Value | Count | Frequency (%) |
| 471.88 | 1 | |
| 466.7 | 1 | |
| 466.03 | 1 | |
| 463.47 | 1 | |
| 460.02 | 1 | |
| 453.06 | 1 | |
| 435.72 | 1 | |
| 429.07 | 1 | |
| 410.38 | 1 | |
| 405.38 | 1 |
Output Token Throughput per User (tok/s)
Real number (ℝ)
| Distinct | 439 |
|---|---|
| Distinct (%) | 70.7% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 6.3422705 |
| Minimum | 1.27 |
|---|---|
| Maximum | 12.93 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 5.0 KiB |
Quantile statistics
| Minimum | 1.27 |
|---|---|
| 5-th percentile | 2.15 |
| Q1 | 3.98 |
| median | 5.7 |
| Q3 | 8.71 |
| 95-th percentile | 12.56 |
| Maximum | 12.93 |
| Range | 11.66 |
| Interquartile range (IQR) | 4.73 |
Descriptive statistics
| Standard deviation | 3.1682055 |
|---|---|
| Coefficient of variation (CV) | 0.49953805 |
| Kurtosis | -0.74005207 |
| Mean | 6.3422705 |
| Median Absolute Deviation (MAD) | 2.22 |
| Skewness | 0.57764697 |
| Sum | 3938.55 |
| Variance | 10.037526 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 6.3 | 4 | 0.6% |
| 3.51 | 4 | 0.6% |
| 4.33 | 4 | 0.6% |
| 4.22 | 4 | 0.6% |
| 5.35 | 4 | 0.6% |
| 5.88 | 4 | 0.6% |
| 3.77 | 3 | 0.5% |
| 3.46 | 3 | 0.5% |
| 4.78 | 3 | 0.5% |
| 4.25 | 3 | 0.5% |
| Other values (429) | 585 |
| Value | Count | Frequency (%) |
| 1.27 | 1 | |
| 1.29 | 1 | |
| 1.34 | 1 | |
| 1.35 | 1 | |
| 1.37 | 1 | |
| 1.4 | 2 | |
| 1.42 | 1 | |
| 1.59 | 1 | |
| 1.64 | 2 | |
| 1.71 | 2 |
| Value | Count | Frequency (%) |
| 12.93 | 1 | |
| 12.88 | 1 | |
| 12.87 | 1 | |
| 12.86 | 1 | |
| 12.85 | 1 | |
| 12.84 | 1 | |
| 12.83 | 1 | |
| 12.82 | 1 | |
| 12.81 | 1 | |
| 12.79 | 2 |
Mean End to End Latency (s)
Real number (ℝ)
| Distinct | 600 |
|---|---|
| Distinct (%) | 96.6% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 62.869614 |
| Minimum | 9.9 |
|---|---|
| Maximum | 408.82 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 5.0 KiB |
Quantile statistics
| Minimum | 9.9 |
|---|---|
| 5-th percentile | 12.1 |
| Q1 | 24.26 |
| median | 44.69 |
| Q3 | 85.26 |
| 95-th percentile | 171.95 |
| Maximum | 408.82 |
| Range | 398.92 |
| Interquartile range (IQR) | 61 |
Descriptive statistics
| Standard deviation | 56.254546 |
|---|---|
| Coefficient of variation (CV) | 0.89478116 |
| Kurtosis | 7.252924 |
| Mean | 62.869614 |
| Median Absolute Deviation (MAD) | 23.55 |
| Skewness | 2.2882123 |
| Sum | 39042.03 |
| Variance | 3164.5739 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 85.29 | 2 | 0.3% |
| 24.94 | 2 | 0.3% |
| 9.95 | 2 | 0.3% |
| 9.99 | 2 | 0.3% |
| 67.93 | 2 | 0.3% |
| 21.92 | 2 | 0.3% |
| 53.08 | 2 | 0.3% |
| 80.35 | 2 | 0.3% |
| 10.27 | 2 | 0.3% |
| 11.63 | 2 | 0.3% |
| Other values (590) | 601 |
| Value | Count | Frequency (%) |
| 9.9 | 1 | |
| 9.91 | 1 | |
| 9.95 | 2 | |
| 9.97 | 2 | |
| 9.99 | 2 | |
| 10.01 | 1 | |
| 10.05 | 1 | |
| 10.11 | 1 | |
| 10.25 | 1 | |
| 10.27 | 2 |
| Value | Count | Frequency (%) |
| 408.82 | 1 | |
| 401.5 | 1 | |
| 321.66 | 1 | |
| 319.32 | 1 | |
| 302.89 | 1 | |
| 296.59 | 1 | |
| 293.96 | 1 | |
| 259.56 | 1 | |
| 256.95 | 1 | |
| 251.9 | 1 |
Mean TTFT (ms)
Real number (ℝ)
UNIQUE
| Distinct | 621 |
|---|---|
| Distinct (%) | 100.0% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 4927.9603 |
| Minimum | 118.09 |
|---|---|
| Maximum | 62123.77 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 5.0 KiB |
Quantile statistics
| Minimum | 118.09 |
|---|---|
| 5-th percentile | 135.28 |
| Q1 | 908.07 |
| median | 2272.42 |
| Q3 | 5778.2 |
| 95-th percentile | 15993.71 |
| Maximum | 62123.77 |
| Range | 62005.68 |
| Interquartile range (IQR) | 4870.13 |
Descriptive statistics
| Standard deviation | 7652.3177 |
|---|---|
| Coefficient of variation (CV) | 1.5528367 |
| Kurtosis | 18.807584 |
| Mean | 4927.9603 |
| Median Absolute Deviation (MAD) | 1797.24 |
| Skewness | 3.739502 |
| Sum | 3060263.3 |
| Variance | 58557967 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 4353.85 | 1 | 0.2% |
| 134.34 | 1 | 0.2% |
| 485.02 | 1 | 0.2% |
| 852.09 | 1 | 0.2% |
| 1167.88 | 1 | 0.2% |
| 1493.15 | 1 | 0.2% |
| 4710.97 | 1 | 0.2% |
| 8675.49 | 1 | 0.2% |
| 134.31 | 1 | 0.2% |
| 483.62 | 1 | 0.2% |
| Other values (611) | 611 |
| Value | Count | Frequency (%) |
| 118.09 | 1 | |
| 120.24 | 1 | |
| 120.62 | 1 | |
| 120.68 | 1 | |
| 120.78 | 1 | |
| 121.27 | 1 | |
| 122.07 | 1 | |
| 122.62 | 1 | |
| 123.09 | 1 | |
| 123.72 | 1 |
| Value | Count | Frequency (%) |
| 62123.77 | 1 | |
| 61691.27 | 1 | |
| 61151.66 | 1 | |
| 43912.03 | 1 | |
| 43613.85 | 1 | |
| 43395.86 | 1 | |
| 36289.5 | 1 | |
| 35972.64 | 1 | |
| 35653.44 | 1 | |
| 33745.5 | 1 |
P95 TTFT (ms)
Real number (ℝ)
| Distinct | 620 |
|---|---|
| Distinct (%) | 99.8% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 11188.78 |
| Minimum | 118.09 |
|---|---|
| Maximum | 177512.27 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 5.0 KiB |
Quantile statistics
| Minimum | 118.09 |
|---|---|
| 5-th percentile | 135.28 |
| Q1 | 1079.06 |
| median | 2777.03 |
| Q3 | 7974.5 |
| 95-th percentile | 52134.93 |
| Maximum | 177512.27 |
| Range | 177394.18 |
| Interquartile range (IQR) | 6895.44 |
Descriptive statistics
| Standard deviation | 24391.3 |
|---|---|
| Coefficient of variation (CV) | 2.1799786 |
| Kurtosis | 17.342639 |
| Mean | 11188.78 |
| Median Absolute Deviation (MAD) | 2240.18 |
| Skewness | 3.9360196 |
| Sum | 6948232.2 |
| Variance | 5.9493553 × 108 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 3117.08 | 2 | 0.3% |
| 9782.4 | 1 | 0.2% |
| 208.34 | 1 | 0.2% |
| 1184.65 | 1 | 0.2% |
| 2499.33 | 1 | 0.2% |
| 3226.16 | 1 | 0.2% |
| 5521.16 | 1 | 0.2% |
| 7841.24 | 1 | 0.2% |
| 10649.7 | 1 | 0.2% |
| 7695.18 | 1 | 0.2% |
| Other values (610) | 610 |
| Value | Count | Frequency (%) |
| 118.09 | 1 | |
| 120.24 | 1 | |
| 120.62 | 1 | |
| 120.68 | 1 | |
| 120.78 | 1 | |
| 121.27 | 1 | |
| 122.07 | 1 | |
| 122.62 | 1 | |
| 123.09 | 1 | |
| 123.72 | 1 |
| Value | Count | Frequency (%) |
| 177512.27 | 1 | |
| 158181.89 | 1 | |
| 157111.73 | 1 | |
| 155407.44 | 1 | |
| 153948.84 | 1 | |
| 152639.06 | 1 | |
| 150118.69 | 1 | |
| 113323.7 | 1 | |
| 112796.51 | 1 | |
| 112549.76 | 1 |
Mean Inter Token Latency (ms)
Real number (ℝ)
| Distinct | 615 |
|---|---|
| Distinct (%) | 99.0% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 210.73208 |
| Minimum | 77.36 |
|---|---|
| Maximum | 784.29 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 5.0 KiB |
Quantile statistics
| Minimum | 77.36 |
|---|---|
| 5-th percentile | 79.62 |
| Q1 | 114.74 |
| median | 175.83 |
| Q3 | 252.11 |
| 95-th percentile | 466.02 |
| Maximum | 784.29 |
| Range | 706.93 |
| Interquartile range (IQR) | 137.37 |
Descriptive statistics
| Standard deviation | 126.70877 |
|---|---|
| Coefficient of variation (CV) | 0.60127896 |
| Kurtosis | 3.4637352 |
| Mean | 210.73208 |
| Median Absolute Deviation (MAD) | 67.47 |
| Skewness | 1.6768845 |
| Sum | 130864.62 |
| Variance | 16055.111 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 78.86 | 2 | 0.3% |
| 79.1 | 2 | 0.3% |
| 169.89 | 2 | 0.3% |
| 167.23 | 2 | 0.3% |
| 89.26 | 2 | 0.3% |
| 126.96 | 2 | 0.3% |
| 105.52 | 1 | 0.2% |
| 122.57 | 1 | 0.2% |
| 169.64 | 1 | 0.2% |
| 227.46 | 1 | 0.2% |
| Other values (605) | 605 |
| Value | Count | Frequency (%) |
| 77.36 | 1 | |
| 77.61 | 1 | |
| 77.71 | 1 | |
| 77.75 | 1 | |
| 77.83 | 1 | |
| 77.86 | 1 | |
| 77.92 | 1 | |
| 78.02 | 1 | |
| 78.05 | 1 | |
| 78.16 | 1 |
| Value | Count | Frequency (%) |
| 784.29 | 1 | |
| 774.41 | 1 | |
| 744.17 | 1 | |
| 743.47 | 1 | |
| 729.99 | 1 | |
| 716.31 | 1 | |
| 713.06 | 1 | |
| 704.68 | 1 | |
| 627.4 | 1 | |
| 610.76 | 1 |
P95 Inter Token Latency (ms)
Real number (ℝ)
| Distinct | 615 |
|---|---|
| Distinct (%) | 99.0% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 226.63081 |
| Minimum | 77.36 |
|---|---|
| Maximum | 790.09 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 5.0 KiB |
Quantile statistics
| Minimum | 77.36 |
|---|---|
| 5-th percentile | 79.62 |
| Q1 | 118.85 |
| median | 184.29 |
| Q3 | 286.4 |
| 95-th percentile | 506.83 |
| Maximum | 790.09 |
| Range | 712.73 |
| Interquartile range (IQR) | 167.55 |
Descriptive statistics
| Standard deviation | 138.56042 |
|---|---|
| Coefficient of variation (CV) | 0.61139272 |
| Kurtosis | 1.7847596 |
| Mean | 226.63081 |
| Median Absolute Deviation (MAD) | 76.97 |
| Skewness | 1.3684936 |
| Sum | 140737.73 |
| Variance | 19198.991 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 227.55 | 2 | 0.3% |
| 97.98 | 2 | 0.3% |
| 79.1 | 2 | 0.3% |
| 160.94 | 2 | 0.3% |
| 152.43 | 2 | 0.3% |
| 78.86 | 2 | 0.3% |
| 170.7 | 1 | 0.2% |
| 78.05 | 1 | 0.2% |
| 228.88 | 1 | 0.2% |
| 290.54 | 1 | 0.2% |
| Other values (605) | 605 |
| Value | Count | Frequency (%) |
| 77.36 | 1 | |
| 77.61 | 1 | |
| 77.71 | 1 | |
| 77.75 | 1 | |
| 77.83 | 1 | |
| 77.86 | 1 | |
| 77.92 | 1 | |
| 78.02 | 1 | |
| 78.05 | 1 | |
| 78.16 | 1 |
| Value | Count | Frequency (%) |
| 790.09 | 1 | |
| 779.42 | 1 | |
| 749.51 | 1 | |
| 746.09 | 1 | |
| 732.47 | 1 | |
| 721.06 | 1 | |
| 715.95 | 1 | |
| 707.32 | 1 | |
| 631.24 | 1 | |
| 616.16 | 1 |
attn_input_reshape_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_input_reshape_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_input_reshape_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_input_reshape_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_input_reshape_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_kv_cache_save_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_kv_cache_save_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_kv_cache_save_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_kv_cache_save_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_kv_cache_save_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_prefill_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_prefill_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_prefill_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_prefill_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_prefill_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_decode_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_decode_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_decode_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_decode_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_decode_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_output_reshape_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_output_reshape_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_output_reshape_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_output_reshape_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_output_reshape_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
embed_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
embed_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
embed_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
embed_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
embed_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
input_layernorm_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
input_layernorm_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
input_layernorm_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
input_layernorm_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
input_layernorm_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_pre_proj_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_pre_proj_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_pre_proj_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_pre_proj_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_pre_proj_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_rope_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_rope_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_rope_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_rope_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_rope_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_post_proj_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_post_proj_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_post_proj_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_post_proj_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
attn_post_proj_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
post_attention_layernorm_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
post_attention_layernorm_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
post_attention_layernorm_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
post_attention_layernorm_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
post_attention_layernorm_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_up_proj_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_up_proj_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_up_proj_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_up_proj_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_up_proj_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_act_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_act_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_act_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_act_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_act_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_down_proj_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_down_proj_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_down_proj_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_down_proj_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_down_proj_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_add_min
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_add_max
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_add_mean
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_add_median
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
mlp_add_std
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
model_name
Categorical
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| meta-llama/Meta-Llama-3.1-8B-Instruct |
|---|
Length
| Max length | 37 |
|---|---|
| Median length | 37 |
| Mean length | 37 |
| Min length | 37 |
Characters and Unicode
| Total characters | 22977 |
|---|---|
| Distinct characters | 20 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | meta-llama/Meta-Llama-3.1-8B-Instruct |
|---|---|
| 2nd row | meta-llama/Meta-Llama-3.1-8B-Instruct |
| 3rd row | meta-llama/Meta-Llama-3.1-8B-Instruct |
| 4th row | meta-llama/Meta-Llama-3.1-8B-Instruct |
| 5th row | meta-llama/Meta-Llama-3.1-8B-Instruct |
Common Values
| Value | Count | Frequency (%) |
| meta-llama/Meta-Llama-3.1-8B-Instruct | 621 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| meta-llama/meta-llama-3.1-8b-instruct | 621 |
Most occurring characters
| Value | Count | Frequency (%) |
| a | 3726 | |
| - | 3105 | |
| t | 2484 | 10.8% |
| m | 1863 | 8.1% |
| l | 1863 | 8.1% |
| e | 1242 | 5.4% |
| / | 621 | 2.7% |
| M | 621 | 2.7% |
| L | 621 | 2.7% |
| 3 | 621 | 2.7% |
| Other values (10) | 6210 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 22977 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| a | 3726 | |
| - | 3105 | |
| t | 2484 | 10.8% |
| m | 1863 | 8.1% |
| l | 1863 | 8.1% |
| e | 1242 | 5.4% |
| / | 621 | 2.7% |
| M | 621 | 2.7% |
| L | 621 | 2.7% |
| 3 | 621 | 2.7% |
| Other values (10) | 6210 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 22977 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| a | 3726 | |
| - | 3105 | |
| t | 2484 | 10.8% |
| m | 1863 | 8.1% |
| l | 1863 | 8.1% |
| e | 1242 | 5.4% |
| / | 621 | 2.7% |
| M | 621 | 2.7% |
| L | 621 | 2.7% |
| 3 | 621 | 2.7% |
| Other values (10) | 6210 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 22977 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| a | 3726 | |
| - | 3105 | |
| t | 2484 | 10.8% |
| m | 1863 | 8.1% |
| l | 1863 | 8.1% |
| e | 1242 | 5.4% |
| / | 621 | 2.7% |
| M | 621 | 2.7% |
| L | 621 | 2.7% |
| 3 | 621 | 2.7% |
| Other values (10) | 6210 |
tensor_parallel_size
Categorical
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| 2 |
|---|
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Characters and Unicode
| Total characters | 621 |
|---|---|
| Distinct characters | 1 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 2 |
|---|---|
| 2nd row | 2 |
| 3rd row | 2 |
| 4th row | 2 |
| 5th row | 2 |
Common Values
| Value | Count | Frequency (%) |
| 2 | 621 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 2 | 621 |
Most occurring characters
| Value | Count | Frequency (%) |
| 2 | 621 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| 2 | 621 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| 2 | 621 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| 2 | 621 |
pipeline_parallel_size
Categorical
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| 1 |
|---|
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Characters and Unicode
| Total characters | 621 |
|---|---|
| Distinct characters | 1 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 1 |
|---|---|
| 2nd row | 1 |
| 3rd row | 1 |
| 4th row | 1 |
| 5th row | 1 |
Common Values
| Value | Count | Frequency (%) |
| 1 | 621 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 1 | 621 |
Most occurring characters
| Value | Count | Frequency (%) |
| 1 | 621 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| 1 | 621 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| 1 | 621 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| 1 | 621 |
kv_cache_dtype
Categorical
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| auto |
|---|
Length
| Max length | 4 |
|---|---|
| Median length | 4 |
| Mean length | 4 |
| Min length | 4 |
Characters and Unicode
| Total characters | 2484 |
|---|---|
| Distinct characters | 4 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | auto |
|---|---|
| 2nd row | auto |
| 3rd row | auto |
| 4th row | auto |
| 5th row | auto |
Common Values
| Value | Count | Frequency (%) |
| auto | 621 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| auto | 621 |
Most occurring characters
| Value | Count | Frequency (%) |
| a | 621 | |
| u | 621 | |
| t | 621 | |
| o | 621 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 2484 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| a | 621 | |
| u | 621 | |
| t | 621 | |
| o | 621 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 2484 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| a | 621 | |
| u | 621 | |
| t | 621 | |
| o | 621 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 2484 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| a | 621 | |
| u | 621 | |
| t | 621 | |
| o | 621 |
distributed_backend
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
gpu_memory_utilization
Categorical
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| 0.9 |
|---|
Length
| Max length | 3 |
|---|---|
| Median length | 3 |
| Mean length | 3 |
| Min length | 3 |
Characters and Unicode
| Total characters | 1863 |
|---|---|
| Distinct characters | 3 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 0.9 |
|---|---|
| 2nd row | 0.9 |
| 3rd row | 0.9 |
| 4th row | 0.9 |
| 5th row | 0.9 |
Common Values
| Value | Count | Frequency (%) |
| 0.9 | 621 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 0.9 | 621 |
Most occurring characters
| Value | Count | Frequency (%) |
| 0 | 621 | |
| . | 621 | |
| 9 | 621 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 1863 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| 0 | 621 | |
| . | 621 | |
| 9 | 621 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 1863 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| 0 | 621 | |
| . | 621 | |
| 9 | 621 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 1863 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| 0 | 621 | |
| . | 621 | |
| 9 | 621 |
swap_space
Categorical
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| 4 |
|---|
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Characters and Unicode
| Total characters | 621 |
|---|---|
| Distinct characters | 1 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 4 |
|---|---|
| 2nd row | 4 |
| 3rd row | 4 |
| 4th row | 4 |
| 5th row | 4 |
Common Values
| Value | Count | Frequency (%) |
| 4 | 621 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 4 | 621 |
Most occurring characters
| Value | Count | Frequency (%) |
| 4 | 621 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| 4 | 621 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| 4 | 621 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| 4 | 621 |
cpu_kv_cache_size
Categorical
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| 40 |
|---|
Length
| Max length | 2 |
|---|---|
| Median length | 2 |
| Mean length | 2 |
| Min length | 2 |
Characters and Unicode
| Total characters | 1242 |
|---|---|
| Distinct characters | 2 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 40 |
|---|---|
| 2nd row | 40 |
| 3rd row | 40 |
| 4th row | 40 |
| 5th row | 40 |
Common Values
| Value | Count | Frequency (%) |
| 40 | 621 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 40 | 621 |
Most occurring characters
| Value | Count | Frequency (%) |
| 4 | 621 | |
| 0 | 621 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 1242 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| 4 | 621 | |
| 0 | 621 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 1242 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| 4 | 621 | |
| 0 | 621 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 1242 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| 4 | 621 | |
| 0 | 621 |
block_size
Categorical
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| 8 |
|---|
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Characters and Unicode
| Total characters | 621 |
|---|---|
| Distinct characters | 1 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 8 |
|---|---|
| 2nd row | 8 |
| 3rd row | 8 |
| 4th row | 8 |
| 5th row | 8 |
Common Values
| Value | Count | Frequency (%) |
| 8 | 621 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 8 | 621 |
Most occurring characters
| Value | Count | Frequency (%) |
| 8 | 621 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| 8 | 621 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| 8 | 621 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| 8 | 621 |
max_num_batched_tokens
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
max_num_seqs
Categorical
| Distinct | 2 |
|---|---|
| Distinct (%) | 0.3% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| 128 | |
|---|---|
| 64 |
Length
| Max length | 3 |
|---|---|
| Median length | 3 |
| Mean length | 2.6022544 |
| Min length | 2 |
Characters and Unicode
| Total characters | 1616 |
|---|---|
| Distinct characters | 5 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 64 |
|---|---|
| 2nd row | 64 |
| 3rd row | 64 |
| 4th row | 64 |
| 5th row | 64 |
Common Values
| Value | Count | Frequency (%) |
| 128 | 374 | |
| 64 | 247 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 128 | 374 | |
| 64 | 247 |
Most occurring characters
| Value | Count | Frequency (%) |
| 1 | 374 | |
| 2 | 374 | |
| 8 | 374 | |
| 6 | 247 | |
| 4 | 247 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 1616 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| 1 | 374 | |
| 2 | 374 | |
| 8 | 374 | |
| 6 | 247 | |
| 4 | 247 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 1616 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| 1 | 374 | |
| 2 | 374 | |
| 8 | 374 | |
| 6 | 247 | |
| 4 | 247 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 1616 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| 1 | 374 | |
| 2 | 374 | |
| 8 | 374 | |
| 6 | 247 | |
| 4 | 247 |
enable_prefix_cache
Boolean
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 749.0 B |
| False |
|---|
| Value | Count | Frequency (%) |
| False | 621 |
enable_chunked_prefill
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
disable_sliding_window
Boolean
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 749.0 B |
| False |
|---|
| Value | Count | Frequency (%) |
| False | 621 |
quantization
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
rope_scaling
Unsupported
MISSING REJECTED UNSUPPORTED
| Missing | 621 |
|---|---|
| Missing (%) | 100.0% |
| Memory size | 5.0 KiB |
enforce_eager
Boolean
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 749.0 B |
| False |
|---|
| Value | Count | Frequency (%) |
| False | 621 |
max_seq_len_to_capture
Categorical
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| 8192 |
|---|
Length
| Max length | 4 |
|---|---|
| Median length | 4 |
| Mean length | 4 |
| Min length | 4 |
Characters and Unicode
| Total characters | 2484 |
|---|---|
| Distinct characters | 4 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 8192 |
|---|---|
| 2nd row | 8192 |
| 3rd row | 8192 |
| 4th row | 8192 |
| 5th row | 8192 |
Common Values
| Value | Count | Frequency (%) |
| 8192 | 621 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 8192 | 621 |
Most occurring characters
| Value | Count | Frequency (%) |
| 8 | 621 | |
| 1 | 621 | |
| 9 | 621 | |
| 2 | 621 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 2484 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| 8 | 621 | |
| 1 | 621 | |
| 9 | 621 | |
| 2 | 621 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 2484 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| 8 | 621 | |
| 1 | 621 | |
| 9 | 621 | |
| 2 | 621 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 2484 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| 8 | 621 | |
| 1 | 621 | |
| 9 | 621 | |
| 2 | 621 |
num_scheduler_steps
Categorical
| Distinct | 2 |
|---|---|
| Distinct (%) | 0.3% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| 1 | |
|---|---|
| 2 |
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Characters and Unicode
| Total characters | 621 |
|---|---|
| Distinct characters | 2 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 1 |
|---|---|
| 2nd row | 1 |
| 3rd row | 1 |
| 4th row | 1 |
| 5th row | 1 |
Common Values
| Value | Count | Frequency (%) |
| 1 | 378 | |
| 2 | 243 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 1 | 378 | |
| 2 | 243 |
Most occurring characters
| Value | Count | Frequency (%) |
| 1 | 378 | |
| 2 | 243 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| 1 | 378 | |
| 2 | 243 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| 1 | 378 | |
| 2 | 243 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 621 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| 1 | 378 | |
| 2 | 243 |
scheduler_delay_factor
Categorical
| Distinct | 3 |
|---|---|
| Distinct (%) | 0.5% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| 0.0 | |
|---|---|
| 0.5 | |
| 1.0 |
Length
| Max length | 3 |
|---|---|
| Median length | 3 |
| Mean length | 3 |
| Min length | 3 |
Characters and Unicode
| Total characters | 1863 |
|---|---|
| Distinct characters | 4 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 0.0 |
|---|---|
| 2nd row | 0.0 |
| 3rd row | 0.0 |
| 4th row | 0.0 |
| 5th row | 0.0 |
Common Values
| Value | Count | Frequency (%) |
| 0.0 | 209 | |
| 0.5 | 208 | |
| 1.0 | 204 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| 0.0 | 209 | |
| 0.5 | 208 | |
| 1.0 | 204 |
Most occurring characters
| Value | Count | Frequency (%) |
| 0 | 830 | |
| . | 621 | |
| 5 | 208 | 11.2% |
| 1 | 204 | 11.0% |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 1863 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| 0 | 830 | |
| . | 621 | |
| 5 | 208 | 11.2% |
| 1 | 204 | 11.0% |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 1863 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| 0 | 830 | |
| . | 621 | |
| 5 | 208 | 11.2% |
| 1 | 204 | 11.0% |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 1863 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| 0 | 830 | |
| . | 621 | |
| 5 | 208 | 11.2% |
| 1 | 204 | 11.0% |
attention_backend
Categorical
CONSTANT
| Distinct | 1 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 5.0 KiB |
| TORCH_SDPA |
|---|
Length
| Max length | 10 |
|---|---|
| Median length | 10 |
| Mean length | 10 |
| Min length | 10 |
Characters and Unicode
| Total characters | 6210 |
|---|---|
| Distinct characters | 10 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | TORCH_SDPA |
|---|---|
| 2nd row | TORCH_SDPA |
| 3rd row | TORCH_SDPA |
| 4th row | TORCH_SDPA |
| 5th row | TORCH_SDPA |
Common Values
| Value | Count | Frequency (%) |
| TORCH_SDPA | 621 |
Length
Histogram of lengths of the category
Common Values (Plot)
| Value | Count | Frequency (%) |
| torch_sdpa | 621 |
Most occurring characters
| Value | Count | Frequency (%) |
| T | 621 | |
| O | 621 | |
| R | 621 | |
| C | 621 | |
| H | 621 | |
| _ | 621 | |
| S | 621 | |
| D | 621 | |
| P | 621 | |
| A | 621 |
Most occurring categories
| Value | Count | Frequency (%) |
| (unknown) | 6210 |
Most frequent character per category
(unknown)
| Value | Count | Frequency (%) |
| T | 621 | |
| O | 621 | |
| R | 621 | |
| C | 621 | |
| H | 621 | |
| _ | 621 | |
| S | 621 | |
| D | 621 | |
| P | 621 | |
| A | 621 |
Most occurring scripts
| Value | Count | Frequency (%) |
| (unknown) | 6210 |
Most frequent character per script
(unknown)
| Value | Count | Frequency (%) |
| T | 621 | |
| O | 621 | |
| R | 621 | |
| C | 621 | |
| H | 621 | |
| _ | 621 | |
| S | 621 | |
| D | 621 | |
| P | 621 | |
| A | 621 |
Most occurring blocks
| Value | Count | Frequency (%) |
| (unknown) | 6210 |
Most frequent character per block
(unknown)
| Value | Count | Frequency (%) |
| T | 621 | |
| O | 621 | |
| R | 621 | |
| C | 621 | |
| H | 621 | |
| _ | 621 | |
| S | 621 | |
| D | 621 | |
| P | 621 | |
| A | 621 |
A simple visualization of nullity by column.
Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.
| Engine | engine_config_id | run_id | Model | Mean Input Tokens | Mean Output Tokens | Concurrent Requests | Completed Requests | Duration (s) | Request Throughput (req/min) | Output Token Throughput (tok/s) | Output Token Throughput per User (tok/s) | Mean End to End Latency (s) | Mean TTFT (ms) | P95 TTFT (ms) | Mean Inter Token Latency (ms) | P95 Inter Token Latency (ms) | attn_input_reshape_min | attn_input_reshape_max | attn_input_reshape_mean | attn_input_reshape_median | attn_input_reshape_std | attn_kv_cache_save_min | attn_kv_cache_save_max | attn_kv_cache_save_mean | attn_kv_cache_save_median | attn_kv_cache_save_std | attn_prefill_min | attn_prefill_max | attn_prefill_mean | attn_prefill_median | attn_prefill_std | attn_decode_min | attn_decode_max | attn_decode_mean | attn_decode_median | attn_decode_std | attn_output_reshape_min | attn_output_reshape_max | attn_output_reshape_mean | attn_output_reshape_median | attn_output_reshape_std | embed_min | embed_max | embed_mean | embed_median | embed_std | input_layernorm_min | input_layernorm_max | input_layernorm_mean | input_layernorm_median | input_layernorm_std | attn_pre_proj_min | attn_pre_proj_max | attn_pre_proj_mean | attn_pre_proj_median | attn_pre_proj_std | attn_rope_min | attn_rope_max | attn_rope_mean | attn_rope_median | attn_rope_std | attn_post_proj_min | attn_post_proj_max | attn_post_proj_mean | attn_post_proj_median | attn_post_proj_std | post_attention_layernorm_min | post_attention_layernorm_max | post_attention_layernorm_mean | post_attention_layernorm_median | post_attention_layernorm_std | mlp_up_proj_min | mlp_up_proj_max | mlp_up_proj_mean | mlp_up_proj_median | mlp_up_proj_std | mlp_act_min | mlp_act_max | mlp_act_mean | mlp_act_median | mlp_act_std | mlp_down_proj_min | mlp_down_proj_max | mlp_down_proj_mean | mlp_down_proj_median | mlp_down_proj_std | mlp_add_min | mlp_add_max | mlp_add_mean | mlp_add_median | mlp_add_std | model_name | tensor_parallel_size | pipeline_parallel_size | kv_cache_dtype | distributed_backend | gpu_memory_utilization | swap_space | cpu_kv_cache_size | block_size | max_num_batched_tokens | max_num_seqs | enable_prefix_cache | enable_chunked_prefill | disable_sliding_window | quantization | rope_scaling | enforce_eager | max_seq_len_to_capture | num_scheduler_steps | scheduler_delay_factor | attention_backend | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | vllm | c82767ea | e67282eb | meta-llama/Meta-Llama-3.1-8B-Instruct | 50 | 128 | 1 | 1 | 9.99 | 5.74 | 12.24 | 12.82 | 9.99 | 134.34 | 134.34 | 78.02 | 78.02 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 64 | False | NaN | False | NaN | NaN | False | 8192 | 1 | 0.0 | TORCH_SDPA |
| 1 | vllm | c82767ea | 7d6bf0cd | meta-llama/Meta-Llama-3.1-8B-Instruct | 50 | 128 | 10 | 10 | 10.73 | 53.50 | 112.44 | 11.78 | 10.70 | 485.02 | 548.80 | 84.84 | 88.25 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 64 | False | NaN | False | NaN | NaN | False | 8192 | 1 | 0.0 | TORCH_SDPA |
| 2 | vllm | c82767ea | d5a06a09 | meta-llama/Meta-Llama-3.1-8B-Instruct | 50 | 128 | 20 | 20 | 12.57 | 91.85 | 193.12 | 10.09 | 12.50 | 852.09 | 990.90 | 99.16 | 105.46 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 64 | False | NaN | False | NaN | NaN | False | 8192 | 1 | 0.0 | TORCH_SDPA |
| 3 | vllm | c82767ea | d450ced3 | meta-llama/Meta-Llama-3.1-8B-Instruct | 50 | 128 | 30 | 30 | 13.89 | 125.25 | 260.10 | 9.03 | 13.80 | 1167.88 | 1314.49 | 110.81 | 117.53 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 64 | False | NaN | False | NaN | NaN | False | 8192 | 1 | 0.0 | TORCH_SDPA |
| 4 | vllm | c82767ea | 935cadeb | meta-llama/Meta-Llama-3.1-8B-Instruct | 50 | 128 | 50 | 50 | 17.10 | 170.54 | 354.96 | 7.39 | 16.90 | 1493.15 | 1979.54 | 135.42 | 143.89 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 64 | False | NaN | False | NaN | NaN | False | 8192 | 1 | 0.0 | TORCH_SDPA |
| 5 | vllm | c82767ea | c2ef6f38 | meta-llama/Meta-Llama-3.1-8B-Instruct | 50 | 128 | 75 | 75 | 29.44 | 148.22 | 309.81 | 6.30 | 20.42 | 4710.97 | 19092.82 | 163.13 | 243.25 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 64 | False | NaN | False | NaN | NaN | False | 8192 | 1 | 0.0 | TORCH_SDPA |
| 6 | vllm | c82767ea | 88b77240 | meta-llama/Meta-Llama-3.1-8B-Instruct | 50 | 128 | 100 | 100 | 33.38 | 175.27 | 368.36 | 5.70 | 23.85 | 8675.49 | 19821.25 | 188.91 | 265.07 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 64 | False | NaN | False | NaN | NaN | False | 8192 | 1 | 0.0 | TORCH_SDPA |
| 7 | vllm | c82767ea | c2f59fc1 | meta-llama/Meta-Llama-3.1-8B-Instruct | 50 | 250 | 1 | 1 | 19.41 | 3.01 | 12.16 | 12.47 | 19.41 | 134.31 | 134.31 | 80.21 | 80.21 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 64 | False | NaN | False | NaN | NaN | False | 8192 | 1 | 0.0 | TORCH_SDPA |
| 8 | vllm | c82767ea | 81bc52c5 | meta-llama/Meta-Llama-3.1-8B-Instruct | 50 | 250 | 10 | 10 | 20.70 | 28.32 | 113.17 | 11.60 | 20.68 | 483.62 | 615.67 | 86.33 | 92.96 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 64 | False | NaN | False | NaN | NaN | False | 8192 | 1 | 0.0 | TORCH_SDPA |
| 9 | vllm | c82767ea | 15ca93a6 | meta-llama/Meta-Llama-3.1-8B-Instruct | 50 | 250 | 20 | 20 | 23.77 | 49.44 | 194.13 | 9.93 | 23.72 | 892.25 | 962.93 | 100.85 | 106.93 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 64 | False | NaN | False | NaN | NaN | False | 8192 | 1 | 0.0 | TORCH_SDPA |
| Engine | engine_config_id | run_id | Model | Mean Input Tokens | Mean Output Tokens | Concurrent Requests | Completed Requests | Duration (s) | Request Throughput (req/min) | Output Token Throughput (tok/s) | Output Token Throughput per User (tok/s) | Mean End to End Latency (s) | Mean TTFT (ms) | P95 TTFT (ms) | Mean Inter Token Latency (ms) | P95 Inter Token Latency (ms) | attn_input_reshape_min | attn_input_reshape_max | attn_input_reshape_mean | attn_input_reshape_median | attn_input_reshape_std | attn_kv_cache_save_min | attn_kv_cache_save_max | attn_kv_cache_save_mean | attn_kv_cache_save_median | attn_kv_cache_save_std | attn_prefill_min | attn_prefill_max | attn_prefill_mean | attn_prefill_median | attn_prefill_std | attn_decode_min | attn_decode_max | attn_decode_mean | attn_decode_median | attn_decode_std | attn_output_reshape_min | attn_output_reshape_max | attn_output_reshape_mean | attn_output_reshape_median | attn_output_reshape_std | embed_min | embed_max | embed_mean | embed_median | embed_std | input_layernorm_min | input_layernorm_max | input_layernorm_mean | input_layernorm_median | input_layernorm_std | attn_pre_proj_min | attn_pre_proj_max | attn_pre_proj_mean | attn_pre_proj_median | attn_pre_proj_std | attn_rope_min | attn_rope_max | attn_rope_mean | attn_rope_median | attn_rope_std | attn_post_proj_min | attn_post_proj_max | attn_post_proj_mean | attn_post_proj_median | attn_post_proj_std | post_attention_layernorm_min | post_attention_layernorm_max | post_attention_layernorm_mean | post_attention_layernorm_median | post_attention_layernorm_std | mlp_up_proj_min | mlp_up_proj_max | mlp_up_proj_mean | mlp_up_proj_median | mlp_up_proj_std | mlp_act_min | mlp_act_max | mlp_act_mean | mlp_act_median | mlp_act_std | mlp_down_proj_min | mlp_down_proj_max | mlp_down_proj_mean | mlp_down_proj_median | mlp_down_proj_std | mlp_add_min | mlp_add_max | mlp_add_mean | mlp_add_median | mlp_add_std | model_name | tensor_parallel_size | pipeline_parallel_size | kv_cache_dtype | distributed_backend | gpu_memory_utilization | swap_space | cpu_kv_cache_size | block_size | max_num_batched_tokens | max_num_seqs | enable_prefix_cache | enable_chunked_prefill | disable_sliding_window | quantization | rope_scaling | enforce_eager | max_seq_len_to_capture | num_scheduler_steps | scheduler_delay_factor | attention_backend | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 611 | vllm | 4e74f945 | c95f84f5 | meta-llama/Meta-Llama-3.1-8B-Instruct | 550 | 250 | 1 | 1 | 39.51 | 1.50 | 6.28 | 6.35 | 39.51 | 398.51 | 398.51 | 157.40 | 157.40 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 128 | False | NaN | False | NaN | NaN | False | 8192 | 2 | 1.0 | TORCH_SDPA |
| 612 | vllm | 4e74f945 | bbfb7a15 | meta-llama/Meta-Llama-3.1-8B-Instruct | 550 | 250 | 10 | 10 | 47.01 | 12.64 | 52.83 | 5.35 | 46.92 | 2350.33 | 3087.98 | 187.09 | 187.71 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 128 | False | NaN | False | NaN | NaN | False | 8192 | 2 | 1.0 | TORCH_SDPA |
| 613 | vllm | 4e74f945 | e19902be | meta-llama/Meta-Llama-3.1-8B-Instruct | 550 | 250 | 20 | 20 | 59.11 | 20.15 | 84.26 | 4.25 | 59.05 | 4613.30 | 5685.80 | 235.31 | 235.53 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 128 | False | NaN | False | NaN | NaN | False | 8192 | 2 | 1.0 | TORCH_SDPA |
| 614 | vllm | 4e74f945 | a826f1c4 | meta-llama/Meta-Llama-3.1-8B-Instruct | 550 | 250 | 30 | 30 | 70.93 | 25.22 | 105.38 | 3.54 | 70.81 | 4994.74 | 6819.59 | 282.43 | 283.67 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 128 | False | NaN | False | NaN | NaN | False | 8192 | 2 | 1.0 | TORCH_SDPA |
| 615 | vllm | 4e74f945 | 890ff97e | meta-llama/Meta-Llama-3.1-8B-Instruct | 550 | 250 | 50 | 50 | 101.70 | 29.39 | 122.78 | 2.47 | 101.44 | 7116.00 | 10751.27 | 404.72 | 406.71 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 128 | False | NaN | False | NaN | NaN | False | 8192 | 2 | 1.0 | TORCH_SDPA |
| 616 | vllm | 4e74f945 | 943fc334 | meta-llama/Meta-Llama-3.1-8B-Instruct | 550 | 250 | 75 | 75 | 146.61 | 30.60 | 127.90 | 1.71 | 146.37 | 12435.61 | 20640.42 | 583.59 | 586.31 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 128 | False | NaN | False | NaN | NaN | False | 8192 | 2 | 1.0 | TORCH_SDPA |
| 617 | vllm | 4e74f945 | c796d514 | meta-llama/Meta-Llama-3.1-8B-Instruct | 550 | 250 | 100 | 100 | 179.01 | 33.39 | 139.58 | 1.40 | 178.84 | 15993.71 | 27205.89 | 713.06 | 715.95 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 128 | False | NaN | False | NaN | NaN | False | 8192 | 2 | 1.0 | TORCH_SDPA |
| 618 | vllm | 4e74f945 | 93d1b71b | meta-llama/Meta-Llama-3.1-8B-Instruct | 550 | 550 | 1 | 1 | 87.07 | 0.69 | 6.28 | 6.32 | 87.07 | 358.07 | 358.07 | 158.30 | 158.30 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 128 | False | NaN | False | NaN | NaN | False | 8192 | 2 | 1.0 | TORCH_SDPA |
| 619 | vllm | 4e74f945 | 7ea184f7 | meta-llama/Meta-Llama-3.1-8B-Instruct | 550 | 550 | 10 | 10 | 104.01 | 5.74 | 52.64 | 5.29 | 103.94 | 2586.44 | 2893.42 | 188.98 | 189.83 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 128 | False | NaN | False | NaN | NaN | False | 8192 | 2 | 1.0 | TORCH_SDPA |
| 620 | vllm | 4e74f945 | 044b3dde | meta-llama/Meta-Llama-3.1-8B-Instruct | 550 | 550 | 20 | 20 | 133.98 | 8.93 | 81.83 | 4.11 | 133.87 | 4353.85 | 5246.17 | 243.38 | 243.80 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | meta-llama/Meta-Llama-3.1-8B-Instruct | 2 | 1 | auto | NaN | 0.9 | 4 | 40 | 8 | NaN | 128 | False | NaN | False | NaN | NaN | False | 8192 | 2 | 1.0 | TORCH_SDPA |